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PULSE SHAPING FILTER WITH MINIMAL INTERSYMBOL 
INTERFERENCE 

BACKGROUND OF THE INVENTION 
5 FIELD OF THE INVENTION 

The present invention relates to communication systems and, in 
particular, to an improved pulse shaping filter. 

DESCRIPTION OF THE RELATED ART 

1 0 In digital communication systems, data symbols are typically made up 

of a series of square pulses, in which each pulse is transmitted at an 
amplitude of one of at least two binary states. The pulses are generally 
shaped to bandlimit the transmitted signal. 

The Nyquist class of pulse shapes exhibit an amplitude of zero at a set 

15 of equally spaced time instants and minimize the spectrum required to 
transmit signals. By precise positioning of the zero points, intersymbol 
interference (ISI) and the performance degradation associated therewith may 
be avoided. While Nyquist pulses offer spectral efficiency, overall 
performance is highly sensitive to pulse shape. Deviation from the Nyquist 

20 shape can introduce severe performance degradation. 

For example, RF anomalies such as those resulting from SAW and 
ceramic filters and other anomalies across the desired band are typically not 
taken into account when pulse shaping. As such, even though the pulses 
may be nominally "Nyquist pulses," in practice, severe intersymbol 

25 interference may be introduced by the pulse shaping filter. One such filter is 
the pulse shaping filter used in the user and base station of an IS-95 CDMA 
(T I A/El A Interim Standard 95 for Code Division Multiple Access ) cellular 
telephone system Similarly, the IS-136 TDMA (TIA/EIA Interim Standard 136 
for Time Division Multiple Access) standard employs a square root raised 

30 cosine filter to minimize ISI at the optimal sampling point, with pulse shaping 
at both the transmit and receive ends. The IS-95 and IS-136 standards are 
incorporated herein by reference in their entireties as if fully set forth herein. 
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In neither system, however, do the shaping filters take into account the 
radio frequency (RF) anomalies introduced into the system. For example, the 
IS-136 filter(s) are matched only to the digital portion of the receiver and do 
not take into account distortion introduced by the RF and intermediate 
5 frequency (IF) components. As such, there is a need for an improved 
shaping filter that takes into account RF and IF interference. 

SUMMARY OF THE INVENTION 

These and other drawbacks in the prior art are overcome in large part 
10 by a system and method according to embodiments of the present invention. 
An improved shaping filter according to an embodiment of the present 
invention is provided in a communication system. The filter response of the 
shaping filter is generated by constraining the filter coefficients in their 
adaptation at the optimal sampling point and not constraining them at the 
15 non-sampling points. That is, the error metric is updated only at the optimum 
sampling point. 

A method according to an embodiment of the present invention 
includes specifying an initial shaping filter, determining intersymbol 
interference for that filter, and iteratively updating filter coefficients at the 
20 sampling period until the intersymbol interference is at or below a desired 
threshold. 

A telecommunications device according to an implementation of the 
invention includes a transmitter and receiver. Either or both the transmitter 
and receiver may include pulse shaping according to embodiments of the 
25 present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A better understanding of the invention is obtained when the following 
detailed description is considered in conjunction with the following drawings in 
30 which: 

FIG. 1 is a diagram of a telecommunications device in accordance with 
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an implementation of the invention; 

FIG. 2 is a diagram of an exemplary 48 tap transmit filter as specified 
in the IS-95 standard; 

FIG. 3 illustrates the frequency domain representation of the filter of 

5 FIG. 2; 

FIG. 4 illustrates a matched filter W according to an implementation of 
the invention; 

FIG. 5 illustrates an exemplary shaping filter R derived according to an 
embodiment of the invention; 
10 FIG. 6A and FIG. 6B are frequency response amplitude and phase 

diagrams of the filter of FIG. 5; 

FIG. 7 is a flowchart illustrating operation of an implementation of the 
invention; and 

FIG. 8 illustrates convergence of an error term using a method in 
1 5 accordance with an embodiment of the invention. 



DETAILED DESCRIPTION OF THE INVENTION 

FIGs. 1- 8 illustrate a system and method for pulse shaping with 
minimal intersymbol interference. Shown in FIG. 1 is an exemplary 

20 telecommunications transmitter 101 and receiver 103 adapted to use a 

shaping filter and method according to embodiments of the present invention. 
The transmitter 101 and receiver 103 may be exemplary of, for example, a 
basic RF digital communications device. In a system, the transmitter 101 and 
receiver 103 would be among a plurality of similar devices, including mobile 

25 units and base stations. 

The transmitter 101 and receiver 103 respectively transmit and receive 
data over a transmission medium, such as air, cable, optical fiber, etc. The 
transmitter 101 receives an input data stream at a coder 102 which converts 
the stream into a set of symbols. The signal is modulated at modulator 104. 

30 The symbols are then provided to a transmit filter 106 which may include 
pulse shaping according to the present invention, as will be explained in 
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greater detail below. Finally, the signal is then sent over the channel or 
transmission medium. In one implementation, the transmission medium is 
free space. 

The receiver 103 may represent a conventional demodulator. The 
5 receiver 103 includes a down converter 108 that receives the modulated 
carrier from the transmitter 1 01 and translates the signal to baseband. The 
signal is routed to a lowpass filter 110 to reduce noise. A decision circuit 112 
then receives the lowpass filter output. The decision circuit 112 may employ, 
for example, a maximum likelihood or other decision statistic to determine 
1 o which of a number of predetermined discrete targets the receive signal most 
closely resembles. A decoder 1 14 then decodes the output of the decision 
circuit 112. 

As noted above, a transmit filter 106 according to an implementation of 

the invention substantially reduces intersymboi interference. The generation 
15 of the filter coefficients occurs during calibration, for example, at the factory. 

The filter response is generated by constraining the coefficients in their 

adaptation at the optimal sampling point and unconstraining them elsewhere. 

That is, the error metric is updated only at the optimum sampling point rather 

than at every sample. 
20 Derivation of a filter according to an embodiment of the present 

invention is illustrated byway of example. In particular, FIG. 2 illustrates an 

exemplary filter with predetermined spectral characteristics. In particular, the 

filter of FIG. 2 is a 48-tap transmit shaping filter such as specified in IS-95. 

FIG. 3 illustrates in frequency domain the filter of FIG. 2. As shown, the filter 
25 of FIG. 2 has a passband frequency set at f p =590 kHz with a passband ripple 

of about +/- 1 .5 dB. The stopband frequency is set at f s =740 kHz with 

bandreject ripple of about 40 dB. 

As noted above, use of such a transmit filter can induce intersymboi 

interference due to RF anomalies. Thus, according to an implementation of 
30 the present invention, a matched filter W(n) such as that shown in FIG. 4 is 

generated and used to derive an overall shaping filter shown in FIG. 5. The 
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filter of FIG. 5 has a frequency response as shown in FIG. 6A and FIG. 6B. 
As can be seen, the frequency response of the filter of FIG. 5 has minimal 
lobes beyond the main lobe and a linear phase in the region of interest. 

Generation of filter coefficients for the filter of FIG. 4 is described below 
5 by way of example, in FIG. 7, using a modified Least Mean Square (LMS) 
method. It is noted, however, that the method of the present invention is 
applicable using other adaptive methods, such as recursive least squares, 
and the like. 

In a step 700, an initial N-tap filter, h(n), with given spectral 
1 o characteristics is specified. One such filter may be the 48 tap filter shown in 
FIG. 2. In 702, the matched filter h*(-n) of h(n) is specified. The h*(-n) is the 
set of filter coefficients to be adapted. In step 704, the initial set of 
coefficients of the matched filter is set as W0(n)=h*(-n). In 706, a digital data 
sequence, such as a white noise sequence, d is generated. The digital data 
15 sequence may be any suitable data sequence and is used to model the 
channel noise and ISI induced thereby. In 708, the convolution of d and h, 
u=conv(d,h), is obtained. 

An initial shaping filter R0 is obtained in 710 by performing the 
convolution, R, of h(n) and h*(-n), where h*(-n) = W0(n) is an initial matched 
20 filter. Then, the frequency response of R is the product of the frequency 
responses of h(n) and h*(-n). In 712, the coefficients are adapted via the 
modified LMS algorithm below: 

DO WHILE (overall ISI of R > desired ISI) 

For n=L+1:L:N; where L is the sampling period, N is the number 
25 of coefficients. 

e(n)=d(n)-W(n-L)u(n-L:n-L-1+M) T ; where e(n) is the error, W(n) 
are the filter coefficients, and u(n) is as above. 

W(n+L)=W(n)-ue(n)u(n-L:n-L-1+M), where u is an adaptation 

factor. 
30 END 
R=conv(h,W). 
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END 



The desired ISI may be an arbitrary level set to ensure desired performance. 
The method then derives a shaping filter R such that the resulting ISI is less 
5 than or equal to that desired level. The loop index provides that the shaping 
of the filter occurs only at the optimum sampling points, i.e., the upsampling 
period. The error term is the difference between the noise (i.e., channel 
noise) and channel response as shaped by the shaping filter. The error term 
e(n) converges to a minimum level, as shown in FIG. 8. In other 
10 embodiments, the error value may be an arbitrarily chosen minimum or 

threshold. The filter coefficients are then updated with a scaled version of the 
previous value. 

The invention described in the above detailed description is not 
intended to be limited to the specific form set forth herein, but is intended to 
15 cover such alternatives, modifications and equivalents as can reasonably be 
included within the spirit and scope of the appended claims. 
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